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Abstract—The Neighbor Migrating Generator is a simple and 
efficient approach to find the closest potential neighbor(s) with 
a different label for a given instance, and so without the need to 
calibrate any kernel settings at all. This allows determining and 
explaining the most important features that will influence an AI 
model. It can be used to either find the closest neighbor from a 
different class or identify probable features that can differentiate 
classes when creating our model from the full training set. The 
proposed technique works by minimizing a loss function that is 
divided into two components which are independently weighted 
according to two parameters a and (£3, a being self-adjusting. 
Results show that this approach is superior to past techniques 
when detecting the smallest changes in the feature space. 


Index Terms—¥Explainable AI, Interpretable AI, AI, Machine 
learning 


I. INTRODUCTION 


Having a model and describing the decision made by this 
model is a common request from many end-users who are not 
machine learning experts. Being knowledgeable as to why a 
given decision can be extremely helpful to a wide variety of 
professions, especially where risk assessment and analysis is 
critical like in financial or medical jobs. In recent years, focus 
has been put on Explainable AI to fulfill this demand. 

Some of the recent approaches in Explainable AI to un- 
derstand decisions from black box models work essentially 
by observing the effect of small changes to a given input 
and their effect on the output. This allows identifying the 
features in the input space that have the strongest impact 
on the output. Nowadays, this approach to Explainable AI 
is implemented inside various open source frameworks like 
(1). and [3], and makes AI more accessible to non- 
machine-learning experts. However, these approaches have 
some limitation. For instance, results can sometime differ after 
each execution. 

Another method of analysing a model is to consider it as a 
black box and see whether making the smallest adjustments to 
the inputs result in a different output. For instance, when your 
loan application is turned down, this approach can recommend 
what you can do to influence the bank’s decision. 

In this paper we propose a technique that attempts to locate 
the decision border for a given model which improves on past 
research ||4] by estimating the nearest location to the boundary 
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from the loss function used by our model. We demonstrate 
in the result section the utility of our Neighbor Migrating 
Generator (NMG) in both a global and local context for three 
datasets, including a synthetic mathematical model, the Iris 
dataset, and the Pima Indians Diabetes dataset. 


II. LITERATURE REVIEW 


Individual predictions made by experts rely on the fact that 
a human can learn enough about what parameters have the 
biggest influence in the feature space or why a model inferred 
a particular decision. Many ways for individual predictions are 
explained utilising local interpretation tools, such as Individual 
Conditional Expectation (ICE) (5). Counterfactual Explana- 
tions 6], Local Interpretable Model-agnostic Explanations 
(LIME) [7] and SHAP methods which explain a model 
with assigning a weight to each dimensions of inputs. 

ICE is a global method for plotting the global effect 
of modifying each feature individually. ICE can modify one 
feature while retaining the same value for the rest of the feature 
space. It then displays the changes in predictions according to 
the value of the target feature. With ICE, comprehending the 
differences between individual lines in the plot can be difficult 
at times. This can be resolved by centering the curves at a point 
and comparing the predictions to this point, which is known 
as Centered ICE (c-ICE). However, ICE cannot allow one to 
see and detect any association between features (9). which is 
a significant limitation. 

LIME generates a linear approximation of the local 
decision boundary by considering a trained model as block box 
since the reasons behind a prediction for a given input is not 
understandable by users. It develops local surrogate models 
to explain the provided input and the decisions of trained 
model. Explaining consists of three steps. First, LIME alters 
the feature space values (Creating a new training set) and by 
using Gaussian kernels associates a weight to the new samples 
points based on the distance to a given input whenever a new 
instance is passed to the LIME model. The new samples are 
then sent to the trained model to approximate the local decision 
boundary, which would be used to map the inputs and outputs 
together (to extract explanations). LIME explains a model in a 
feature space locally. Laugel et al. have shown that LIME 
is very dependent on some kernel settings because it relies on 


the correct definition of the local neighborhood. This problem 
not only a parameter or sampling distribution issue but has 
a significant impact on the relevance and quality of the local 
black-box decision boundary approximation, and thus on the 
meaning and accuracy of the given explanation. Many studies 
have looked into the development of new local train sets 
(12), however there are certain difficulties to their solutions, 
such as losing sight of a crucial notion like the tangent or 
inspecting small neighborhood without taking linearity into 
account in the ML function. 

Based on cooperative game theory, SHapley Additive ex- 

Planations (SHAP) assigns an important value to each 
characteristic. The purpose of cooperative game theory is to 
figure out how to equitably compensate all participants based 
on their performance. SHAP generates the Shapley score by 
replacing a particular instance value with new values and then 
applying the trained model’s predictions to the new dataset. 
While analysing all the input dimensions would be costly, we 
only need to investigate a subset of them, resulting in slightly 
different outcomes each time. Another drawback in SHAP is 
that the order of features for a given instance might affect the 
prediction. 
Our work is similar to others listed above in that we perceive 
the model as a black box with no access to the internal 
structure or weights. The primary distinction is that we wish 
to discover the closest available neighbor which belongs to a 
different class. 

Unlike the previous techniques cited earlier, Counterfactual 
Explanations [4] and [6] are introduced to highlight the small- 
est modifications needed for a sample to change the prediction 
made by the model. This contrasts with the vast majority of 
the approaches in the area that differ in how they define the 
loss function. Wachter et al. (4). for example, minimise the 
loss function as equation [I] 

arg min maa Af (a’) — y')? + d(z, 2’) (1) 

There, the Manhattan distance (weighted with the inverse 
median absolute deviation) between the original input and the 
modified one is added to the square of the L? norm of the 
differences between the predictions of these inputs. A is a 
weight that indicates how influential the input instance can 
be, a higher value indicating that we do not wish to alter 
values frequently. Categorical features are a problem with this 
approach. Dand1l et al. (6) proposed a new loss function that 
minimized four-section loss and counts the number of altered 
features using the Gower metric and a counter. 


(2) 


The Manhattan distance between f(x’) and y’ is 01, while the 
Gower distance function (02) calculates the distance between 
x (original sample) and x’ (close target sample on the decision 
boundary). o3 calculates the number of features that have 
been altered. Finally, 04, calculates the distance between the 


estimated sample and the nearest observed sample in the train 
set. 

Our work is similar to the two approaches described above, 
in which a model is trained for each case in order to determine 
the smallest modification that can change the class label for 
prediction. Nevertheless, it differs as to how we define a loss 
function that freely allows the model to change along with 
the feature space. In addition to allowing the model to decide 
the amount of change required by self adjusting the kernel 
settings, we have introduced a new way of finding the most 
influential features for a given model by training its NMG 
model representative of the decision boundaries with all the 
training set samples (instead of a single sample) and analyse 
the modifications. 


III. THE NEIGHBOR MIGRATING GENERATOR MODEL 


The first step in solving an issue is to formulate a question. 
When you write a problem in a different approach, you’ll get a 
different answer with a different level of efficiency. However, 
each option has advantages and disadvantages. Writing in the 
space is a well-known example. One to ask this question is 
how to write in the space, which requires a simple pencil 
which its leads that can easily break and pose a risk to 
electronic devices. Another way to phrase the subject is to 
ask how we can alter a pen to write in space which bring a 
Space pen as solution. There are a variety of approaches to 
solving this problem, but that is not our emphasis. Each of 
the solutions mentioned in background section try a different 
approach to writing the question. For instance, Dandl is et 
al. are looking for the smallest number of modified features 
that result in a different class label, whereas we’re looking 
for the nearest feasible neighbor with a different class. This 
section will describe our new model, its two variants, and 
how to train it. The two variants differ according to whether 
we are interested in local explanations or global ones. For a 
local explanation, the model will be trained to look at the 
closest decision boundary to a given sample, while the global 
explanation will look at the most influential features for each 
of the classes. For both variants we use the same architecture 
but train them by feeding them with either a single sample 
(local) or all of them (global). A new model G is associated 
to an original model F’ we would like to explain. 


A. Local and Global Variants 


With the local explanation variant, the NM generator then 
uses standard methods in machine learning to discover a 
neighbor. A single input is going through the fully connected 
network G, and we minimize the loss function described later 
on to converge to a point close to the original sample but with 
a different target label that is assigned by the user. As such, 
the NMG tries to detect and change only the main features 
which lead to that class, hinting at the most influential factors 
for a given sample. 

Another possible application of our model is to view feature 
migration in the global space, hinting at the most influential 
factors for a given class instead. In this approach, instead of 


specifying which class label we need to migrate to, we use 
the predictions of a trained model F' to generate labels. We 
use the second most likely (or predicted) class label and put it 
as target label. We train our Neighbor Migrating Generator G 
on the entire training set, with A now being a vector instead 
of a scalar value (i.e., we have now one scalar value for each 
sample of the training set). It is important to note that for 
the global variant an NMG uses the same model for all the 
samples, which attempts to limit the impact of outliers and 
produce more generic results, while for the local variant we 
train the model separately for each input instead and thereby 
generating different weights each time. With the global variant, 
however, we may not be able to establish a minimum loss cost 
for outliers but this would not affect the final results. 

The global approach can be formalised as follow. Let d 
be the number of classes, n the number of samples, and 
fF the original network mapping an input sample x; to a 
vector of inferred probabilities for each class F'(a;), with 
each component represented as F'(x;). We now define the 
best prediction of our original network H}(x;) as: 


H7-(a4) = arg max F(x;) = {j| Fy(xi) < Fe(ai) Vk € d} 
i) 


(3) 
and the second best class prediction H?.(x;) as: 
H7(x;) = argmax F(2;,;) = 
a (4) 


{3 | Fj(ai) < Fa(wi) Vk € dk A Hp(2i)} 


We can now define our new NMG model G trained from a 
set of samples D such that: 


G:D7>D 
v, = G(ai) | Hp (xi) = Hp(2i) A 5) 
Va" € D, H2(a;) = Hp(a")A 


G(2i) |r|] #1 — 2" |lu 


with / indicating the norm used. 

After the training process, we calculate for each input 
feature the sum of the differences between the input samples 
x; and the nearest corresponding samples with a different label 
defined as x, = G(a;). x; is essentially an imaginary sample 
that we want located on the class decision boundary in the 
feature space and that intends to be as close as possible to 
the initial sample x;. For a given feature f this is equal to 
Ty = 7 |xi(f) — xi (f)| as shown in Fig. [1] Larger values of 
I indicate that a feature has a larger impact and therefore is a 
major contributor in explaining how the model distinguishes 
between classes. An application of this will be presented in 
section IV-B. 

where d in number of classes and nm shows features di- 
mensions and m represents number of samples. Also, We 
have shown trained model with fF and NM-Generator with 
G . Function F, map the input sample to the likelihood 
of being in each classes. C; and C, are used to find the 
first and nth maximum argument in the their input array. 
Therefore, #2 used C2 to find second likelihoods of classes 
in F’s prediction. After G find the appropriate sample on the 
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Algorithm 1: Algorithm for calculating the loss func- 
tion at each iteration 
A < 0 /*Importance of the inner loss*/; 
e< 0.05 /*A constant for the the thickness of the 
decision boundary*/ ; 
for each iteration do 
if (y == y’) then 
| A < clip(A + 1.0, 100.0); 
else 
| A < clip(A — 1.0, 0.0); 
end 
in_loss ~ (X/100.0) * (So (a, — x4)) ; 
By,y <— |CrossEntropy(1,y == y’) 
—CrossEntropy(0.5 + €,0.5 — €)|; 
out_loss + CrossEntropy(y, y’); 
loss = in_loss + out_loss + By y" 


end 


border with different class, J; refers sum of the differences 
between X and X’. With J, and C,, is the nth influential 
feature for the model F’. 


Figure 1. Calculation of the Feature Importance weights J that returns an 
explanation of the global impact of features for the different classes of the 
original model. 
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B. Loss function 


Algorithm[I]shows how the loss function for G is calculated 
during each iteration. The loss function that is to be minimized 


is the same for both variants, as given in equation |7|, and 
illustrated in figure 


L(z,2',y,y’) = CrossEntropy(y, y’)+A . L'(a—2')+By,y" 
(7) 
Where y is the class label for x, and y’ is the predicted label for 
x’. \ is a weight recalculated after each training step, and ,,_,/ 
a cross entropy function as discussed in the next paragraph. 
The equation is divided into three parts. The first part 
(CrossEntropy) represents the difference in information be- 
tween the current and the new labels. The second part (L") 
which shows how near we want to be to the input. Instead 
of calculating the Euclidean distance, we use the Manhattan 
distance because we are mainly interested in a method that 
changes as few features as possible, even though the L? 
distance could be used as well, as we will analyze in the result 
section. Indeed, the L1 norm has the property of producing 
an output with only a small number of features presenting a 
significant change. When using L? instead, we see changes 
that are distributed on more features, which is undesirable if 
we mainly want to identify the most prominent features only. 
The last component of the loss function is the 8, , param- 
eter. This component is calculated as 


By, = |CrossEntropy(1,y == y')— 
CrossEntropy(0.5 + €,0.5 — €)|, 
With € = 0.05. 


which prevents the first part of the loss function from having 
a value too close to zero, allowing the second part to have a 
greater probability of changing. 

Finally, X is a parameter in the range [0,1] that tries to 
emphasize the importance of being close to the input value. 
This value is initialized to zero in the first step, allowing the 
model to adjust the input as much as needed to change the 
label. The value for any x’ increases gradually after each 
correct label, and decreases if the label is wrongly guessed. 
One advantage of this strategy is that parameters do not need 
to be adjusted manually, and the model can converge to the 
appropriate value x’. 


Figure 2. Loss function of Neighbor Migrating Generator 
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IV. EXPERIMENTAL RESULTS 


We experimented our new approach on three different 
datasets: a synthetic 2D heart function dataset, the Pima 
Indians Diabetes Database, and the IRIS dataset. 


All tests are performed on an Intel 4770K processor running 
at 3.9 GHz and coupled with 32 GB of RAM and an Nvidia 
GeForce GTX 3070TI Graphics card. Tensorflow 2.0 is used 
as the AI framework and runs on a Linux distribution. 

Each features in the all dataset have been standardized to 
the range [—1, 1], with a mean value of 0 to ensure that each 
dimension has an equal probability to change as both the 
L* and L? norms are obviously sensitive to the units used 
for features. For training, we use an Adam optimizer with a 
learning rate set to 10~*. Every layer in the models has a Relu 
activation function, with the exception of the last layer which 
is just linear. Our models are trained for 200 epochs and the 
best model is saved. A description of the architecture of the 
three original models and their associated NMG models can 
be found in Table 


A. Implicit Heart Function Dataset 


Figure 3. Example of the migration obtained with our NMG model G for 
some random samples on an implicit 2D heart function {13}. Blue dots are 
class 0 samples while red dots are class 1. The green dots are chosen random 
samples that are transformed with our NM Generator. Results show that the 
NMG model satisfactorily migrates samples to decision boundary. 
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To demonstrate the impact of loss function in the decision 
of our model for our local variant model, we created an 
artificial dataset from a two-dimensional slice of a heart- 
shaped function described in (eq. [8). Any point inside 
the heart is labelled as one, and zero otherwise. We regard the 
original model as a black box once trained and we will use it 
only to see how far our new predictions are from the border 
decision. 


f (a1, @2) = (w] + 43-1) — aj 25 
1 if f(@1, £2) <0 
Y= 0 


otherwise 
To identify the distribution of decision boundaries with our 
NMG, we use again a fully connected network with three 
layers, each with 256 neurons, and a final layer with two 
neurons only, as the output should have the same number 
of features as the input. The distribution of the function is 


(8) 


Samples Number of Glucose Diastolic Blood Skin Insulin BMI Diabetes Age 
/ Class Pregnancies mg/dl Press., mm Hg Thickness U/ml kg/m? Pedigree year 
migration < 140 < 80 mm 16 — 166 < 25 Function 
1:10 2 100 66 20 90 32.9 0.867 28 
+3.5 (+175%) -0.1 (-12%) 
2:0 31 4 129 86 20 270 35.1 0.231 23 
+18.8 (15%) 
3:10 3 169 74 19 125 29:9 0.268 31 
-0.1 (-1%) -21.9 (-18%) 
4,0 51 2 101 58 35 90 21.8 0.155 22 
+0.9 (41%) +0.2 (+1%) -88.4 (-98%) | +2.2 (+10%) +1.1 (45%) 
5:0>1 3 96 56 34 115 24.7 0.944 39 
+1.3 (443%) +0.6 (+2%) +1.3 (45%) 
6051 1 118 58 36 94 33.3 0.261 23 
-23.2 (-25%) 
7.051 0 114 80 34 285 44.2 0.167 27 
+46.3 (441%) -30.1 (-38%) -19.9 (-59%) -186 (-65%) -22.4 (-51%) | +0.1 (460%) | +37.9 (+140%) 
8: 051 1 87 68 34 TI 37:6 0.401 24 
+4.4 (+18%) 
9051 5 96 74 18 67 33.6 0.997 43 
-4 (-80%) +11 (+11%) -6.1 (-8%) +1 (46%) -54 (+81%) -6.5 (-19%) -0.8 (-80%) -18.9 (-44%) 
10:13 0 3 107 62 13 48 22.9 0.678 23 
-5 (-5%) 
11: 150 9 156 86 28 155 34.3 1.189 42 
-4.7 (-52%) -45.4 (-29%) +0.9 (43%) -0.5 (-42%) 
12:1>0 1 128 48 45 194 40.5 0.613 24 
-0.1 (-10%) -9.7 (-8%) +37.9 (+79%) -5.7 (-13%) +25.9 (413%) +5 (+12%) +0.2 (433%) +1.8 (48%) 
Table T 


VARIATION AMONG FEATURES WHEN CHANGING INSTANCES (LOCAL VARIANT OF THE ALGORITHM) FOR THE PIMA INDIAN DIABETES DATASET FOR 12 
RANDOMLY SELECTED SAMPLES. THIS DATASET CONTAINS SEVERAL CHARACTERISTICS FOR PATIENTS UNDERGOING AN ORAL GLUCOSE TOLERANCE 
TEST, INCLUDING INSULIN AND GLUCOSE LEVELS AFTER TWO HOURS AND THE TYPE 2 DIABETES STATUS (0 BEING NON-DIABETIC). UNITS AND 
STANDARD RANGES FOR GLUCOSE, BLOOD PRESSURE, INSULIN AND BODY MASS INDEX ARE GIVEN AT THE TOP, AND SAMPLES OUTSIDE THE RANGE 
ARE HIGHLIGHTED IN RED. THE SECOND VALUE IN CELLS, WHEN PRESENT, INDICATES THE VARIATION GENERATED BY THE MIGRATION MODEL ON 
SOME OF THE FEATURES. UNCHANGED VALUES ARE NOT SHOWN. 


Item Descriptions Feature Name Description Range 
Dataset Implicit Heart Function Dataset Pregnancies Number of pregnancies [0..17] 
Model F Input(2),FC(256),RelU,FC(256),RelU,FC(2),Soft-Max Glucose Oral glucose tolerance test, [0..199] 
Model G Input(2),FC(256),RelU,FC(256),RelU,FC(256),RelU,FC(2) measured after 2 hours. 

Dataset PIMA BloodPressure Diastolic blood pressure [0..122] 

Model F Input(8),FC(256),RelU,FC(256),RelU,FC(2),Soft-Max SkinThickness Triceps skin fold thickness [0..99] 

Model G Input(8),FC(256),RelU,FC(256),RelU,FC(256),RelU,FC(8) Insulin Insulin level after 2 hours [0..846] 

Dataset TRIS BMI Body Mass Index [0..67.1] 

Model F Tnput(4),FC(128),RelU,FC(128),RelU,FC(),Soft-Max DiabetesPedigreeFunction | Diabetes history in relatives | [0.08..2.42] 

Model G | Input(4),FC(1024),RelU,FC(1024),RelU,FC(1024),RelU,FC(4) Age Age in Years [21..81] 
Table IT Table TIT 


DESCRIPTION OF THE ARCHITECTURE OF THE MODELS WE USED FOR THE 
THREE DATASETS. THE F’ MODEL IS THE ORIGINAL MODEL WE WANT TO 
STUDY, WHILE G IS THE NMG MODEL USED TO MIGRATE TO DECISION 
BOUNDARIES. 


depicted in the Figure 3B] We have assigned two random point 
inside and outside the heart and we have drawn the output 
position given by our NMG. The findings reveal that the model 
was able to locate the decision boundary well with both L! 
and L? Norms. 


B. Pima Indians Diabetes Database 


The Pima Indians Diabetes Database includes seven 
continuous but sometime incomplete features and a categorical 
binary feature that indicates whether or not a patient has 
diabetes of type 2. It contains 768 individual that are at least 
21 years old, female and of Pima indian heritage. 


DESCRIPTION OF FEATURES IN THE PIMA DIABETES DATASETS. 


Table [III] lists the features present in the dataset. 

We have define model fF with 2x fully connected layers 
with 256 neurons with Relu activation and final layer has 
2 output with a Soft-max activation. While our Model G is 
consist of 3x layers with 256 neurons Relu activation where 
the last layer has linear activation with 7 neurons. 

We put our Neighbor Migrating loss function to the test in 
order to determine the smallest adjustments required to change 
the label for a given sample. However, the results depend on 
accurateness of the trained model but the loss function shows 
that the NMG is able to detect minimum changes to migrant a 
sample to different class. We have shown some of the results 
in the table ?? 


In this example, we apply our local NMG variant on a set of 


13 random samples to see what minimal changes can be made 
to a sample to switch class. Here again, our NMG migrated to 
the decision border by minimizing the loss function of an input 
sample. The very first sample we tested (Table ??) actually 
demonstrated that something was not right with the original 
model. There we see that the NMG prioritises a change in 
the blood pressure. While diabetes patients have often high 
blood pressure, diabetes is mainly detected from glucose or 
insulin levels in the blood, which can be tested two hours 
after ingesting 75mg of glucose (Oral Glucose Tolerance Test 
- OGTT). While the NMG migrated the sample to a nearby 
point very similar to the original one, but still clearly in the 
diabetic range, the original model was inferring it as non- 
diabetic. A study of 12 more samples (Table [Ip indicated that 
this was not an exception (e.g. samples 1,3, 6) while other 
samples looked more logical (e.g. sample 2 migration to a 
diabetic status logically increases parameters like glycemia 
and insulin but also BMI and blood pressure parameters, which 
are frequently raised for diabetic patients.). 

The only explanation for small non-logical changes being 
able to change sample classes was that the original model was 
over-fitting. This was confirmed afterward by a) noticing that 
the model had far more parameters than samples (Table[IIp, and 
b) that training accuracy was 100% but testing accuracy was 
only 73%, typical of over-fitting. Therefore, in this example 
our NMG was able to indicate to a domain expert that over- 
fitting was happening in the original model, even before details 
of the training were disclosed to him. 


C. IRIS 


The IRIS dataset is well-known for incorporating 
many measures into taxonomy difficulties. The original dataset 
includes 50 samples from each of the three Iris species 
(Uris Setosa, Iris Virginica, and Iris Versicolor) for a to- 
tal number of 150 items. Each sample has four attributes 
measured in centimetres (length and width for both the sepals 
and petals). In particular, Fig. |4) shows that two out of the 
four features are enough to provide a good separation of the 
three classes. This figure also gives a good insight of the 
neighboring relationships between classes. The global variant 
of our Neighbor Migrating Generator is then applied to this 
dataset to see if this Neighbouring relationship can be captured 
by our technique. Therefore, with this global approach, the 
model learns how to go to the nearest border rather than 
specifying which class border it should learn. 


Original Migrated | Sepal L | Sepal W | Petal L | Petal W 

Virginica | Versicolor | 0.0662 0.0207 0.5398 0.0965 

Versicolor | Virginica 0.0340 0.0081 0.3372 0.0033 

Setosa Versicolor | 0.3106 0.4010 0.9289 0.7361 
Table IV 


VARIATION AMONG FEATURES WHEN CHANGING INSTANCES. 


Our global NMG model is defined by three fully connected 
layers of 1024 neurons with Relu activation to explain the 
global features of the dataset this time. New labels in the 


Figure 4. 2D plotting the IRIS dataset. The graph indicates that using only 
two features (Petal Length and Petal Width) out of four is enough to 
separate most samples of this dataset. Note that Iris Versicolor appears to 
be in between the two other classes. 
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training set are defined by the second best predicted label 
of the original model , and we train the Neighbor Migrating 
Generator with the training set. Results in Table |[V|show that 
the migration of the three different classes corresponds pretty 
much to what can be observed in figure |4} with for instance 
the Setosa and Virginica classes migrating the Versicolor 
class and the latter one being migrated to the closest of the 
two, i.e., Virginica. 

We have trace variance between training sets and model 
prediction after training the model. For example, converting 
*Iris-setosa’ to ’Iris-versicolor’ requires mostly adjusting the 
*Petal Length’ attribute in the input. We can examine the most 
influential characteristics in the financial decision or, in other 
respects, what feature can distinguish classes the most from a 
list of features that need to alter most of the time. This results 
been shown in Table 


V. CONCLUSION 


We introduced the Neighbor Migrating Generator in this 
work, which is a method for finding the closest neighbor with 
a different class label. In other words, the Neighbor Migrating 
Generator searches for decision boundaries that will allow us 
to change a given input with the least amount of effort. Our 
NMG can be used to determine the smallest modifications 
as well as the inflectional dimensions in decision space that 
distinguish the classes. In three experiments, we for instance 
demonstrated the capability of our generator to: a) find de- 
cision borders (e.g., heart function) in the original model; b) 
look for over-fitting in results (e.g., Pima Indians Diabetes 
Database); and c) provide close neighboring clues between 
classes (Iris dataset). Another benefit is that, compared to 
previous approaches [4], our method can learn the border 
without having to change any kernel parameters, resulting in 
more reliable outcomes. 

Future work could extend this technique in various ways. 
Having the option of either changing which features users 
want to alter or not changing them would be an interesting 


continuation for the present work, which possibly could be 
implemented using an additional mask vector for the loss 
function. This functionality would mainly be beneficial to 
our local variant of the NMG model. Furthermore, for the 
global neighboring algorithm variant we could establish a 
visualization tool of the decision boundaries that could help 
understanding the impact features have on the decision made 
by the original model. 
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